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ABSTRACT 

This paper presents an architecture and a hardware 
prototype of a Flexible Trellis Modem / Codec (FTMC) 
transmitter. The theory of operation is built upon a pragmatic 
approach to trellis-coded modulation that emphasizes power 
and spectral efficiency [1]. The system incorporates 
programmable modulation formats, variations of trellis- 
coding, digital baseband pulse-shaping, and digital channel 
precompensation. The modulation formats examined include 
(uncoded and coded) Binary Phase Shift Keying (BPSK), 
Quartenary Phase Shift Keying (QPSK) , Octal Phase Shift 
Keying (8PSK), 16-ary Quadrature Amplitude Modulation (16- 
QAM), and Quadrature Quadrature Phase Shift Keying 
(Q2psK) at programmable rates up to 20 Megabits per 
second (Mbps). The FTMC is part of a developing test bed to 
quantify modulation and coding concepts. 

INTRODUCTION 

Regenerative transponders employing onboard-processing 
and switching techniques are active topics in satellite 
communications [2, 3, 4]. One common feature among the 
architectures proposed is the presence of modems and 
codecs both on the ground and in the spacecraft. The 
modems and codecs are used with multiple access schemes 
designed to optimize both uplink and downlink capacities. 
Generally, they trade some mix of bandwidth and power 
efficiency. 

Frequency Division Multiple Access (FDMA) is an appropriate 
multiple access technique for low-rate bandwidth efficient 
uplinks from a large number of ground terminals. In this type 
of uplink, bandwidth efficiency is directly related to the 
amount of uplink traffic attainable. Time Division Multiplexing 
(TDM) is envisioned in high-rate downlinks for its power 
efficiency. In TDM, nonlinear High Power Amplifiers (HPA’s) 
can be operated at saturation without the adverse effect of 
intermodulation and distortion as long as the modulated 
signal maintains a constant envelope. Spread spectrum 
techniques such as Code Division Multiple Access (CDMA) 
are used for their power efficiency for the same reasons as 
TDM. CDMA has also shown increased spectral efficiency in 
some systems and may be suitable for both uplinks and 
downlinks. 

In the future, as data throughput requirements increase to 
offer wider band services, TDM or CDM downlinks may not 
only be limited by available transmit power but also by 
channel, transponder, and ground terminal bandwidths. For 
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example, Travelling Wave Tube Amplifiers (TWTAs) qualified 
for space environments today exhibit bandwidths on the 
order of 1 to 5 percent of the operating frequency [5]. Higher 
output power TWTAs generally afford lower bandwidth 
percentages. Technologies such as electronically steerable 
phased arrays that employ patch antennas can be designed 
to exhibit bandwidths on the order of 10 percent of their 
operating frequencies, though they become simpler and 
smaller at more modest bandwidths of 1 to 3 percent. Also, 
digital modem and codec hardware can be designed to 
operate almost exclusively at the symbol rate, as opposed to 
the bit rate. Thus, higher bit throughput rates can be 
accomplished at lower processing rate by using modulation 
schemes with more bits per symbol. This may be useful in a 
TDM downlink exhibiting high rates to a number of low-cost 
ground terminals. 

Increased flexibility is another dimension in future satellite 
systems. The on-orbit reconfiguration of the modulation and 
coding hardware offers the potential to provide more network 
capacity, increased network availability, multiple service 
classes, and higher percentage availability at the expense of 
increased complexity. Efficient use of capacity could be 
obtained with a network that charges users for the amount of 
network resources required. Users that require high data and 
low error rate services would expend more channel 
bandwidth and/or power per transmitted bit than user with 
lower quality and rate service requirements. Wider 
availability may be obtained with flexible transmission 
formats suited to particular user requirements. Higher 
percentage availability may be achieved by reconfiguring to 
more conservative modulation and coding formats 
overcoming outages such as rain attenuation and multipath 
fading at the expense of network capacity. 

This set of possible operating environments warrant the 
investigation of modems and codecs that can offer future 
satellite systems increased operational performance and 
flexibility. 

The first section of this paper presents an overview of the 
modulation and coding test bed under development. The 
second section describes the modulation and coding 
formats supported by the FTMC. The next section develops 
the digital pulse shaping techniques. Digital baseband 
precompensation methods for nonlinear channel distortion 
are then described. The prototype transmitter that includes 
the baseband modulator and IF upconversion is described 
next. Finally, conclusions are drawn as to the applicability 
the techniques presented. 

SYSTEM CONFIGURATION 

Though this paper focuses on the^FTMC transmitter, a brief 
description is given of the test bed under development. The 


"Work Supported by Grant NAG3-1183, High Precision 
Waveform Equalization for Optimum Digital Signalling. 


295 


proposed FTMC test bed architecture is shown in Figure 1. 
System control is performed through a personal computer 
that features a graphical user interface for ease of system 
configuration and operation. FTMC configuration data is 
generated via object-oriented simulation software on a 
workstation. The real time data flow through the FTMC 
begins with either Pseudo-Random Binary Sequence (PRBS) 
or patterned test data generated by a digital transmission 
analyzer (DTA). The DTA is docked with the FTMC modulator 
hardware at the programmed data rate. TDM formatting is 
done by the burst controller. The baseband modulated 
waveform is then generated by the FTMC modulator. 
Translation to a 70 MHz IF is performed through quadrature 
upconversion techniques. The data can then either be 
translated to RF for amplification via a TWTA or directly to a 
calibrated IF noise combiner. The signal is then 
downconverted to baseband where it is filtered, 
demodulated, and decoded by the FTMC demodulator 
currently under development. 


m j(t) = h(t) * s,(t) 
m Q(t) = h(t) * s Q (t) 

where sj(t) and SQ(t) are the information carrying signals. 
The information carrying signals can be represented as 
square pulses over the symbol time T s of an amplitude 
corresponding to the constellation definition. The function 
h(t) is the impulse response of the bandlimiting pulse shape 
and is described in the next section. Convolution is denoted 
by the * symbol. In the case of Q^PSK the information 
carrying signals correspond to the following expressions 

S|(t) = ai (t)*pi (t) + a 2 (t)*p 2 (t) 
sqW = a 3 (t)* P i(t) + a 4 (t)*p 2 (t) 



Figure 1. FTMC Test Bed 


MODULATION AND CODING 

The FTMC supports a number of different modulation 
formats. Each can be represented in quadrature form by the 
equation 

x tx (t) = m|(t)cos(27if c t) + mQ(t)sin(27if c t) 


where each a n (t) corresponds to a positive or negative 
amplitude, depending on the information sequence. The pi (t) 
and p2(t) are a set of two orthogonal pulse shapes that also 
maintain orthogonality with the quadrature mixing operation. 
These conditions can be defined explicitly by the relations 


where xtx(t) denotes the resulting modulation at a carrier 
frequency f c . The signals mj(t) and mQ(t) represent the 
baseband modulating functions. Three Phase Shift Keyed 
(PSK) techniques are supported that include BPSK, QPSK, 
and 8PSK. An amplitude and phase modulated technique, 
16-QAM, as well as a phase and pulse-shape modulated 
technique Q^PSK [6], are also supported . In the PSK and 
QAM cases the baseband modulating functions represent 
the in-phase and quadrature bandlimited values associated 
with the signalling constellation. These can be written as 



p^tWtJdt = o 


f( n + 1 )t s 

pi(t )e j2 " ,c 'dt = 0. i=1,2 

nT s 
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f c = m = integer >1 

\2TJ 

where n is an integer to define integration over any symbol 
time. There are an infinite number of pj(t)'s that satisfy the 
above conditions. A few are developed in [6] that address 
the issue of phase continuity as well as spectral occupancy. 
In general, any modulation format whose S|(t) and SQ(t) can 
be represented by two or fewer bits can be created by the 
FTMC modulator. This is clarified in the waveform synthesis 
section. 

The bit to symbol mapping of all the modulation formats are 
designed to operate in conjunction with a standard 
convolutional code of constraint length K=7 and rate 1/2 with 
generator polynomials G -j ^ — 1 338 an ^ ® 12 “ 1 71 8 exhibiting 
the maximal attainable dfree of 10 (Figure 2). This approach 
allows the use of a single encoder and decoder to be used 
with the programmable modulation formats to achieve a 3 to 7 
dB coding gains at real spectral efficiencies (using 40% 
Nyquist pulse-shaping filters) up to 2.14 bits/second/Hz. 
Coding gain can be approximated accurately at lower bit- 
error-rates by the Asymptotic Coding Gain (ACG). The 
calculation of ACG is based on the most likely decoding error 
event. The most likely decoding error event for unmerged 
paths with length greater than one is called the Unmerged 
Squared Euclidean Distance (USED). As shown in [1] USED 
for MPSK can be expressed as 


USED > 2sin 



+ ( dfree" 4 )sin -^L , 

M 


M > 4 


where M is the modulation order of the coded scheme. 
Codes with parallel branches (and thus single branch errors 
events) have a Parallel Squared Euclidean Distance (PSED), 
again for MSPK, expressed as 


PSED > sin 



M >8 


ACG is defined as the ratio of the minimum of the USED or 
PSED to the Normalized Euclidean Distance (NED) for 
uncoded performance. NED can be written as 

NED = sin 2 ! 2?L j 


Modulation 

Format 

Code 

Rate(s) 

Asymptotic 
Coding Gain 

~Eb/No for 
Pb = 10- 6 

Spectral 

Efficiency* 

BPSK 

NA 

NA 

10.5 dB 

0.72 

QPSK 

NA 

NA 

10.5 dB 

1.43 

8PSK 

NA 

NA 

14.0 dB 

2.14 

16QAM 

NA 

NA 

14.4 dB 

2.86 

TQPSK 

1/2 

7.0 dB 

4.5 dB 

0.72 

T8PSK 

2/3 

3.0 dB 

7.5 dB 

1.43 

T16QAM 

2/4 

4.3 dB 

6.5 dB 

1.43 

T16QAM 

3/4 

3.6 dB 

10.4 dB 

2.14 


* In bits/sec/Hz assuming 40% Nyquist Filtering 


Table 1 : Modulation and Coding Performance 



The particulars of each coding scheme can be described by 
a generator matrix of the form 


Gn->k = 


Gii Gi 2 
G2 1 


Gi k 
G2K 


Gnl Gt 2 Gik J 


where n is the number of input bits and k is the number of 
output bits from the encoder. The Gjj's are the activated 
convolutional encoder shift register taps written in an octal 
form. The k output bits are mapped into a 2 k - ary modulation 
scheme in a manner that maximizes the Euclidean distance 
of the code. For trellis-coded QPSK (TQPSK) the generator 
matrix is 


Gi ->2 = [ 133 e 171a 1 


and thus the ACG (in dB) for MPSK is 


ACG > lOlogio J4 Min^ 


cos' 


2[ 2 n 

M 



Evaluations of this expression are given in Table 1. Uncoded 
performance was calculated using standard bounds [7, 8] for 
gray coded mappings. Note that for M=4 ACG is determined 
by the USED and for M=8 ACG is determined by the PSED. A 
similar argument will be discussed to evaluate QAM 
performance. 


Each information bit is coded into one QPSK symbol. A gray 
mapping of the encoded bits is used. For this code the ACG 
is determined by the USED of the seven symbol long error 
event path. The code and mapping structure is illustrated in 
Figure 3. Note the encoder output bits read from the top to 
bottom correspond to the bit to symbol assignments read 
from left to right. 
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Figure 3. Trellis Coded QPSK 
Similarly . for T8PSK and T16QAM the generator matrices 


C»2 >3 = 


133 e 171 b 0 
o 0 100e J 


= 


133 8 171 s 

0 0 

0 0 


0 0 
100 8 o 
0 100 8 J 

The code and mapping structures are shown in Figures 4 and 

b2, bl, bC 
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Figure 4: Trellis Coded 8PSK 
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Figure 5 : Trellis Coded 16 


>-QAM (Mapping #1) 

?finAu ally ^ a i r f te 2 / 4 time ' var ying code is supported for the 
16QAM modu a ion format. This code maps two information 
bits into one of 16 modulation points. The first bit is encoded 

a7 v 0a ‘ W ^| b[t T u ymb01 tha ! ^ermines the quadrant of the 16- 
aiy symbo . The second information bit is encoded into a two 
bit symbol that chooses a "sector" within the previously 
chosen quadrant. This sector and quadrant determine a 

Zl’t'ZZT' ,h ‘ ' 60AM ,orma ' The 

Q 2-4=[ 133 8 1 71 3 Jc[ 1 3 3 g 171g ] 

where c denotes a demultiplexing operation The 
Figure 6 atl ° n mapP ' n9 and the code structur e is illustrated in 
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Figure 6: Trellis Coded 16 QAM (Mapping #2) 

For Mapping #1 the PSED is the dominated error event 
However, it is difficult to calculate due to the nature of the 
decision regions. However, its performance is given in [1] as 
approximately 10.4 dB E b /N 0 required to obtain a bS-error 

gray coded sJsk." " C ° din9 93i " ° f 3 6 dB aS Compared t0 

an^^Th* 2 th0re ar ® n ° parallel paths so ‘he PSED is not 
an issue. The approximate USED is 1.34 as calculated hv 

|j° m t pa [| lng ! he ,irst ®j; ror event path with the all zero path in 

QPSK is' S dla£,ram ‘ The ACG as compared to the NED of 


ACG > lOlogto y§£B-] = 1 
L NED 


Olog, 


1.34 


If) 


4.3 dB 


WAVEFORM SYNTHESIS 

lo reduce spectral occupancy, a Static Random Access 
(S [? AM) D,str 'buted Arithmetic (DA) technique is 

Ilf 40 and on SIZe prec,sion baseband pulse-shapes ?9, 10, 
11]. 40 and 20 percent square-root and full Nyquist raised 
cosine waveforms have thus far been generated at 

rnmh? an t d by , samplin 9 and storing the 9 appropriate 
combinations of transmitted data patterns. The full Nyquist 
pu se patterns were generated for testing purposes only \he 
data were sequentially generated for all symbol combinations 

timefcT fl C l! ied S / apertures - An aperture is the length of 
time for a specified number of symbols to occur. 9 


Kf) 


/ *T S 
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f 
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where T s is the symbol period in seconds, 3 is the rolloff 
ate, and fh is the half-amplitude frequency which equals 
1/2T S . Taking the inverse Fourier transform of equation H(f) 
the impulse response is found to be '' 
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T s sin 

M1-P)t' 

cos 

n (1 + P )t 

4 p t . 
t r s i n 

*<1-P)tl' 

Ts . 

T 3 

1 S 

Ts J 

h(t) = 

4P 

T s 

n (l - P )+ 4 P 

4 P 1 ^ | 4 P t j 2 



where h(0) = 1 and 



4p 

w (l -P )+ 4 P. 


sin 

JL(l-p>' 

it IcosT-5- 

+sin 

’ 71 " 

11 


Up 
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4P. 
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The rolloff rate 0 is expressed as a percentage and controls 
the trade-off between the bandwidth and pulse duration. A 
lower rolloff rate will allow for a narrower passband, but its 
impulse response will cause more ISI. 

Aperture lengths of 6 and 12 symbols were investigated 
depending on the modulation scheme involved. Data were 
collected for 8, 16, and 32 samples per symbol. Each 
symbol was shaped with the SRRCF and the effects of 
adjacent pulse responses were accounted for over the 
center symbol period. As the aperture length is an even 
number, the actual data collected represent the transition 
from one symbol to the next. The amount of memory required 
to represent the full set of data on each orthogonal channel 
for a given modulation format is 

. .aperture 
memory = sps x levels r 


BASEBAND PRECOMPENSATION 

Everything accomplished thus far assumes all subsequent 
signal transformations are ideal linear operations. However, 
the nonlinear responses of devices such as TWTA s distort 
and degrade the signalling scheme. As a second order 
approximation, a narrow band, frequency independent, 
memoryless model of a TWTA has Amplitude to Amplitude 
(AM/AM) and Amplitude to Phase (AM/PM) characteristics 
that can be modeled as 


A(r(t)) = 


2r(t) 

1 +r 2 (t) 


r z (t) 

<D(r(t)) = 

1 +r 2 (t) 


where sps is the number of samples per symbol and levels is 
the number of amplitude levels on one axis of the 
constellation. The amount of memory can be reduced by 
exploiting the symmetry in certain modulation formats. The 
flexible aspect of this pulse shaping procedure is that data 
can be generated for any rolloff rate, samples per symbol, or 
symbol aperture length with high precision. A typical 
software generated eye-diagram is illustrated in Figure 7. 



Normalized Symbol Numbei 

Figure 7: 8PSK Example Eye Diagram. 


where r(t) is the input amplitude level to the TWTA. Many 
techniques such as precompensation, equalization, and ISI 
cancelling have been proposed to minimize this type of 
nonlinearity [12. 13, 14], In general, transmitter 

precompensation can occur at baseband , IF or RF. IF and 
RF precompensation have been applied in many terrestrial 
microwave radio systems. The limitations observed in these 
applications are lack of flexibility, long term stability, and 
difficulty of accurate construction. For these reasons, there 
has been interest in applying digital signal processing 
techniques to perform baseband precompensation. 
Amplitude and phase distortion for an operational TWTA can 
be determined empirically and thus precisely 
precompensated. Most implementations thus far have 
focussed on memoryless systems that warp the signalling 
constellation with an inverse transform of the amplitude and 
phase response of the TWTA nonlinearity. However, in 
systems using pulse shaping, the r becomes r(t) causing the 
warping to indtroduce additional ISI that results in degraded 
bit-error-rate performance and spectral regrowth. This 
problem can be solved by using a memory based 
architecture [15] similar to the pulse shaping technique. This 
technique reduces ISI accurately to the symbol aperture It 
is interesting to note that this technique is well suited for 
satellite communications that use lower order modulation 
schemes. In terrestrial microwave systems, high order 
modulation schemes are typical. This puts a significant 
limitation on the aperture and thus accuracy that can be 
obtained. The memory size as shown in the waveform 
synthesis section depends exponentially on the number of 
discrete amplitude levels of the constellation. 
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The precompensation is implemented in terms of signal 
space vectors relative to each modulation scheme. The 
vectors are the complex representation of the in-phase and 
quadrature sample values. The magnitude and phase of 
these vectors is precompensated for a set a data that 
represents the AM/AM and AM/PM characteristics of the 
nonlinearity. The magnitude precompensation can be 
accomplished by extending the linear portion of the AM/AM 
curve. The input signal value enters the precompensator 
and the output power is found relative to the linear extension 
of the data. This value is then found on the actual data 
curve, and the corrected input backoff corresponding to this 
new point is output to the rest of the system. Next, the 
corrected input backoff is further corrected for the AM/PM 
characteristics of the curve. The phase shift corresponding 
to this input backoff is found, and this value is subtracted 
from the phase of the signal entering the TWTA. An example 
eye diagram of precompensated data for BPSK is shown in 
Figure 8. A square root 40 percent raised cosine pulse was 
used to shape the data at 16 samples per symbol with a 
twleve symbol apeture. Measured AM/AM and AM/PM curves 
from a TWTA were used to model the nonlinearity. Figure 10 
shows the precompensated scatter plot. As shown in Figure 
9 the precompensated data exhibits increased spectral 
occupancy that must be included in the bandwidth 
calculations for the modulation upconversion and 
amplification functions. The clustering and ISI effects seen 
in the eye diagram are products of the square root filter A 
full raised cosine or matched square root raised cosines do 
not exhibit these effects. Figure 11 shows the eye diagram 
after the TWTA distortion and a matched receive finite 
impulse response filter with 96 taps. 


This type of precompensation would be particularly useful in 
an operational system. A network using precompensation 
could adapt and load new precompensation data as nonlinear 
channel characteristics changed. Comparisons are being 
generated that compare the total degradation for a set of 
modulation formats as a function of input backoff, filtering, 
and symbol aperture for baseband precompensated signals. 






FTMC TRANSMITTER HARDWARE 

Prototype hardware has been constructed to verify FTMC 
concepts with real system nonidealities. The transmitter 
block diagram is shown in Figure 12 and the FTMC modem 
chassis layout in Figure 13. Serial data can be clocked in at 
FTL levels continuously or in a bursted format. This data is 
then translated to a parallel format of one to four bits wide 
One bit is supplied to the rate 1/2 k=7 convolutional encoder' 
and the rest bypass it. Uncoded, coded, and burst control 
bits (total of nine address bits) are supplied to a modulation 
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mapping function. This modulation mapper is a 512 X 4 bit 
SRAM loaded with four bits of information that represent four 
in-phase and four quadrature levels. This information (either 
data or preamble) is turned broadside to generate symbol 
apertures via shift registers. Symbol apertures are 
transformed into pulse-shaped symbols with the Nyquist 
pattern generators. The pattern generators are each 128K X 
8 SRAM's. The SRAM’s are loaded with the patterns 
qenerated via the techniques discussed in the waveform 
synthesis section. The eight bit samples output from the 
filter SRAMs are either directly output to the digital to analog 
converters or used as address bit to the precompensator. 
The precompensator performs the nonlinear transformation 
as described in the precompensation section. The digital to 
analog converters use eight bit quantization. Figures 14 
through 19 show eye diagrams and spectrums of four of the 
modulation formats, using full 40 percent raised cosine 
pulse shapes. In each figure, the sample rate is 32 768 MHz 
and there are 32 samples per symbol. This gives a bit rate ot 

Bit rate !5!EE!f_2!S log 2 (M>) 

samples per symbol 



Figure 13. FMC Chassis Mechanical Layout 


Each spectrum is plotted in a frequency window 
corresponding to the width of the main lobe, 2/T b> of a BPSK 
signal with the same bit rate, where is the bit time. 


Burst Control 
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Data In 



DAC 


Analog 

Baseband 

In-Phase 


DAC 


Analog 

Baseband 

Quadrature 


Figure 12 : Digital Baseband Modulator / Encoder 


The IF upconversion module translates the baseband 
modulated signal to 70 MHz using standard quadrature 
upconversion techniques (Figure 20). The 70 MHz carrier is 
obtained from an analog signal generator that can be phase 
locked to the symbol time to satisfy Q 2 PSK orthogonality 
conditions. Direct Digital Synthesizers (DDS) could also be 
used to generate the IF carrier. 

The quadrature spectral reconstruction filters are designed 
to accommodate the full range of FTMC operation in terms of 
data and sampling rate. The signal bandwidth (assuming no 
spectral shaping) is obtained as 

BW = 

sps 

where f s is the sampling frequency and sps is the number of 
samples per symbol. The maximum bandwidth, BW ma x is 5 


MHz. This occurs when f a is 40 MHz and sps is 8 samples 
per symbol. The spectral reconstruction filters must contain 
this frequency in their passband. The other constraint 
defining the frequency response of the reconstruction filters 
is the lowest alias frequency. This occurs at f s = 10 MHz ana 
sps = 8, giving 


_fs 

sps 


f alias =f s~^ = 10 MHz - 


10 MHz = 8.75 MHz 


8 sam/sym 


This falias of 8.75 MHz must be in the st0 P band 0< . the fllter 
response. The resulting filter mask is shown in Figure 21, 
with the 48 dB of attenuation specification obtained from the 
quantization error of the 8 bit digital to analog converters 
Note that the eventual limit of available sample rates and 
data rates is limited by the lack of in * b ® 

reconstruction filter. To maintain the low level of IS obtained 
by the Nyquist filters the group delay variation is limited to 
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15 nanoseconds up to 3.5 MHz. This means that 40 percent 
Nyquist filters (cutoff approximately 3.5 MHz) will have a 
group delay over their entire bandwidth of no more than 

symbol BW _ 15 nS _ 7 R % 

Mnax “* 

Tsymbol max 200 nS 

for the worst case symbol rate of 5 Msps. This effect causes 
an expected Efc>/N 0 degradation of no more than a few tenths 
of a dB. 


group delay variation : 15 nS from 0 to 3.5 MHz 



MHz 


Figure 21 : Spectral Reconstruction Filter Mask 

CONCLUSION 

The architecture and hardware prototype of a flexible trellis- 
coded modem and codec transmitter has been presented. 
The FTMC transmitter uses digital modulation and coding, 
multi-symbol digital pulse shaping, and digital 
precompensation to tradeoff complexity for improved signal 
quality, bandwidth, and power efficiency. This type of 
architecture is envisioned to be of use in FDMA satellite 
uplinks and TDM or CDM satellite downlinks. 

In any planned operational satellite network, the choice of 
modulation and coding techniques is dictated heavily by 
numerous other system concerns. However, offering future 
system designers workable flexible modems and codecs 
may relieve specifications in other subsystems and offer an 
enhanced satellite system that can offer more varied and 
higher quality services. 
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